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Abstract 

A geometric method is described to characterize the different kinds of ex- 
tremals in optimal control theory. This comes from the use of a presymplectic 
constraint algorithm starting from the necessary conditions given by Pontrya- 
gin's Maximum Principle. Apart from the design of this general algorithm useful 
for any optimal control problem, it is showed how it works to split the set of 
extremals and, in particular, to characterize the strict abnormality. An example 
of strict abnormal extremal for a particular control-affine system is also given. 
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1 Introduction 

A difficult problem in optimal control is to obtain extremals, that is, curves candidates 
to be optimal solutions. The usual way to deal with that is through successive 
differentiations of some necessary conditions for optimality, see for instance [3l [6l [19] . 
Here we not only give a method to split the set of extremals for any optimal control 
problem, but also explain geometrically the meaning of the successive differentiations. 

There are different kinds of extremals: normal, abnormal and strictly abnormal. 
The abnormal extremals have been partially ignored for years. In the nineties, the 
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papers by R. Montgomery, W. Liu and H. J. Sussmann [261 123j showed up the im- 
portance of analyzing abnormal extremals, because they can be optimal. Therefore, 
the search for abnormal and also strict abnormal extremals has become an appealing 
issue for the last fourteen years, as is backed by [21 HI [6l [HI [Til [12 |32l [33]- The main 
attraction of abnormality is its exclusive dependence on the geometry of the control 
system and for the strict abnormality is the fact that the strict abnormal extremals 
are not normal. 

The essential result to describe the general method of this paper and to have tech- 
niques to solve optimal control problems is Pontryagin's Maximum Principle, despite 
only providing necessary conditions for optimality. Although the natural geometric 
framework of Pontryagin's Maximum Principle is the symplectic one \18 \ \22 \ [30], to 
our purpose the presymplectic formalism will be more useful [1'6\ I25j. Then, we have 
an implicit equation including some compatibility conditions, that must be satisfied 
in order to have solution, besides the dynamical Hamilton's equations. The former 
is a necessary condition of the maximization of the hamiltonian over the controls 
according to the classic Maximum Principle }^20\ I29j . Hence, in the presymplectic 
framework a weaker version of Pontryagin's Maximum Principle is stated. Instead of 
the above classic necessary condition, we have an implicit differential equation that 
sets up a constraint algorithm in the sense given in [10^ \T5\ \W[ [T7] . This presym- 
plectic algorithm comes from the Dirac-Bergmann theory of constraints developed in 
the fifties for quantum field theory. This algorithm has been already adapted and 
used to study singular optimal control problems [13] and to study optimal control 
problems with nonholonomic constraints |21j . 

The aim of this paper, according to the previous optimal control formulation, is 
to give a precise and geometric description of how to use the constraint algorithm 
to determine where the dynamics of normal extremals takes place and also the dy- 
namics of abnormal ones. We also obtain sufficient conditions to have both kinds 
of extremals. These conditions elucidate how to determine the strict abnormality. 
This adaptation of the algorithm to the study of the extremals is mostly developed 
in ^ under the assumption of the control set being open and the differentiability 
with respect to the controls whenever is needed. 

The importance and the generality of the theory elaborated can be highlighted 
by the revisit of the characterization of abnormal extremals in some known examples 
such as subRiemannian geometry and single-input control-affine systems. Using the 
algorithm and distinguishing different cases that come up, it may be checked that 
some of the situations correspond with the results obtained by A. A. Agrachev, Y. 
Sachkov, I. Zelenko, W. Liu and H.J. Sussmann [31[11[2H]. Our method collects all 
their results on the existence of abnormal extremals. So the described procedure 
allows us to study geometric and generically the extremals for any control system 
and obtain the dynamics of the abnormal extremals in a natural and understandable 
way. 

The organization of the paper is as follows: in Section 2 after a brief review of 
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some notions in optimal control theory, we state the optimal control problem and 
Pontryagin's Maximum Principle in the suitable framework for this paper, that is, in 
the presymplectic one. Section 3 concentrates on the new material, so it is devoted 
to describe the geometric process used to characterize extremals in optimal control 
problems with fixed time. After studying the fixed time problem, we explain how 
the algorithm works for the free time case in Section 4. Finally, in Section 5, we 
find a strict abnormal extremal for a control-affine system using the presymplectic 
constraint algorithm. 

In the sequel, all the manifolds are real, second countable and C°°. The maps are 
assumed to be C°°. Sum over repeated indices is understood. 



2 Presymplectic optimal control problems 

A control system is defined by a set of differential equations depending on parameters. 
More precisely, let M be a smooth manifold, dimAf = m, ?7 be an open set of M'^ 
called the control set with k < m. A vector field X along the projection vr : M xU ^ 
M is a map X : M x U ^ TM such that the following diagram is commutative 




where tm is the natural projection of the tangent bundle. We denote the set of these 
vector fields as X{7t). A control system is an element of X{7t). 

Let / C ]R, a curve (jju) : I ^ M x U is an integral curve of X if 

7 = Xo(7,n), that is, j{t) =X{j{t),u{t)). (2.1) 
Now, we can introduce a cost function F: M x U — > R and the functional 

S[j,u] = j^F{^,u)dt 

defined on curves (7, u) with a compact interval as domain. We are interested in the 
following problem: 

Problem 2.1. (Optimal Control Problem, OCP) 

Given the elements M, U, X , F , I = [a, 6], Xa, E M. Find (7,u) such that 



(1) the endpoint conditions are satisfied 7(a) = Xa, 7(6) = Xb, 

(2) 7(t) = X{-f{t),u{t)), t G /, and 

(3) 5[7,ii] is minimum over all curves on M x U satisfying (1) and (2). 
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A solution (7, u) to this problem is called optimal curve. The mappings (7, u): I ^ 
MxU are piecewise differentiable and the vector field X along vr and the cost function 
F: M X U are differentiable enough. 

2.1 Pontryagin's Maximum Principle 

As was said in ^ we state Pontryagin's Maximum Principle from a presymplectic 
viewpoint [13^ [T^ [2T\ [25] . In this approach, the main elements are: 

• The presymplectic manifold [T*M x C/, 0), where Vt is the closed 2- form on 
T*MxU given by the pull-back through in: T*M xU ^ T*M oi the canonical 
2-form on T*M. 

• A presymplectic Hamiltonian system (T* M xU,^l, H), where H : T*MxU ^ R 
is the Pontryagin 's Hamiltonian function given by 

H{X,u) = {X,X{x,u)) +poF{x,u) = Hx{X,u) + pqF{x,u), 

with A e T*M, po G {-1,0} and the notation Hx{X,u) = {X,X{x,u)). 

Observe that the kernel of 0, contains the vri-vertical vector fields, that is, tti- 
projectable vector fields Z € X{T*M x U) such that {■ki)^Z = 0. Thus, O is de- 
generate. For details in presymplectic formalism see [lOl [I5l [El [ITJ [25l [27] . 

Theorem 2.2. (Pontryagin's Maximum Principle, presymplectic form) Let 

U C be an open set and (7, u): [a,b] ^ M x U be a solution of the optimal control 
problem \2.1\ with endpoint conditions Xa, a^b- Then there exist A: [a,b] — > T*M along 
7 (i.e. the natural projection of X to M is 7J, and a constant pq G { — 1,0} such that: 

1. (A,u) is an integral curve of a Hamiltonian vector field Xh that satisfies 



2. (a) H{X{t),u[t)) is constant everywhere in t £ [a,b]; 
(b) {po, X{t)) / for each t G [a, b]. 

As is degenerate, (|2.2|) does not have solution in the whole manifold T*M x 
U. As explained in § [3l it may have a solution if we restrict the equation to the 
submanifold defined implicitly by 



iXff^ = d-ff, that is, i^; 



(A(i),«(t)) 



n = dH{X{t),u{t)); 



(2.2) 



S = {(3 £T*M xU\i^dH = 0, for v G ker 17^}, 



and locally, S = {(3 e T*M x U I — = 0, 1 = 1,... 

oui 



k}. 
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Remark 2.3. Observe that this is a necessary condition for the Hamiltonian to 
have an extremum over the controls as long as U is an open set. In the classic 
Pontryagin's Maximum Principle j29], the Hamiltonian is equal to the maximum of 
the Hamiltonian over the controls. Therefore, Theorem 12.21 is a weaker version of the 
classic Maximum Principle. 

The necessary conditions 1-2 of Theorem 12.21 determine different kinds of ex- 
tremals. 

Definition 2.4. A curve (7, u): [a, 6] — > M x [/ is 

1. an extremal for OCP if there exist A: [a, 6] — > T*M and a constant pQ € 
{ — 1,0} such that {X,u) satisfies the necessary conditions of Pontryagin's Max- 
imum Principle; 

2. a normal extremal for OCP if it is an extremal and po = —I, that is, the 
Hamiltonian is H^~'^'^ = Hx — F; 

3. an abnormal extremal for OCP if it is an extremal and pq = 0, that is, the 
Hamiltonian is H^^^ = Hx; 

4- a strictly abnormal extremal for OCP if it is not a normal extremal, but 
it is an abnormal extremal; 

The curve (A, u) : [a, b] T*M x U is called biextremal for OCP. 

Pontryagin's Maximum Principle lifts optimal solutions to the cotangent bundle. 
The uniqueness of the lifts is not guaranteed, that is, some extremals could be lifted 
in two different ways: normal and abnormal. 

3 Characterization of extremals 

Here we take advantage of the necessary conditions in Theorem 12.21 to determine 
where the different kinds of extremals above defined are contained. We are specially 
interested in strict abnormal extremals and abnormal extremals as a consequence 
of [23^ [26] . A meaningful and constructive procedure in presymplectic manifolds in 
order to find a solution to Problem 13. II is the constraint algorithm |i m 1151 [TCI I17 t l27j. 

Problem 3.1. Given a presymplectic system {M,0,, H), find {N,X) such that 

(a) N is a submanifold of M, 

(b) X ^ X{M) is tangent to N and verifies ix^ = di^ on N, 

(c) N is maximal among all the submanifolds satisfying (a) and (b). 
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As mentioned in § l2.1l the presymplectic equation ()2.2p . ixh^ — has solution 
in the primary constraint submanifold Nq = {x & M \ 3vx T^M , iv^,^ = dxH}, 
or equivalently, A'^o = {x S M | (LzH)^ = 0, V Z G kerO}, where Lz is the Lie 
derivative with respect to Z. See [HI [27] for details on these equivalence. 

Locally, Xh = A'd/dx' + Bjd/dpj + Qd/dui with = dH/dpi and Bj = 
—dH/dx^ because of the presymplectic equation (|2.2p . Moreover, as d/dui £ kerO, 

iVo = {(A,n)GT*Mx[/| — = A,-^+P07^ = 0, 1 = 1,. ..,k}. (3.3) 

The solution on Nq is not necessarily unique. Indeed, if Xq is a solution, then 
Xo + ker O is the set of all the solutions. We may consider Xq as a vector field defined 
on the whole M because A'^o is closed and we assume that Nq is a submanifold of M. 

Take the pair (A'o,A'o +kerr2), rewritten as (A'o,-'^^"). Observe that we are 
looking for an element in tangent to Nq. Then, 

Ni = {x£Nq\3X gX^\ X{x) £ T,Nq}, 

locally 

Ni = {(A, u) £No I = Xh (^^^ = dH/dpid'^H/dx'dui - dH/dx^d'^H/dpjdui 

+Crd'^H/durduu l = l,...,k}. (3.4) 

If the matrix (dH/durdui)ri, multiplying Cr, is not invertible, the OCP is singular 
[T3] . otherwise it is regular. 

This step stabilizes the constraints in Nq providing a new pair {Ni,X^^) where 
X^^ is the set of the vector fields solution and tangent to Nq. Inductively, we 
arrive at {Ni,X^') where we assume that A^j is a submanifold of M and we define 
Ni+i = {x £ Ni\3X £ X^- , X{x) £ T^Ni}, obtaining the sequence 

M 2 A^o 2 A^i D . . . D A^i D A'i+i 2 . . . 

and the corresponding X^'+i. Let 

Nf = f]N,, X'^f = f]X^^, 

i>0 i>0 

if {Nf,X^f) is a nontrivial pair, it is the solution to Problem 13.11 If at one step 
A^j = A^i+i, the algorithm finishes with Nj = N^. 

Note that each step of the algorithm can reduce the set of points of M where there 
exists solution, that is, Ni C A^j_i, and can also reduce the degrees of freedom of the 
set of vector fields solution, X^"- C In terms of control systems, the desirable 

objectives are to restrict the problem to a smaller submanifold of T*M x U and to 
determine the input controls. Observe that, generally, a step of the algorithm can 



M. Barbero-Linan, M. C. Munoz-Lecanda Algorithm for extremals 



7 



provide us new constraints and the determination of some controls at the same time. 
Hence, either a unique vector field is found or the new constraints must be stabilized 
or the set must be split in submanifolds. At the final step, we have either a unique 
or nonunique vector field and a submanifold that could be an empty or discrete set. 

Remark 3.2. Observe that we do not miss any extremal using the constraint algo- 
rithm, in contrast to what happens in subRiemannian geometry in [23] . where using 
a less geometric approach they miss the constant extremals. 

Now, let us focus again on optimal control problems where there are two distinct 
Hamiltonians depending on the value of the constant po- Thus, from ()3.3p it is 
deduced that the constraint algorithm must be run twice, one for each Hamiltonian, 
as is explained in ^3.H 13. 2[ 



3.1 Characterization of abnormality 

First, we characterize a subset of T*M x U where the abnormal biextremals are, if 
they exist. In this situation pQ = and the corresponding Pontryagin's Hamiltonian 
is fft'^l = Hx- Then the primary constraint submanifold (|3.3p becomes 

rni dX^ 

= {{X,u) eT*M xU\Xi^— = 0, l = l,...,k}, (3.5) 

OUl 

the submanifold (|3.4|) is 

and the algorithm continues. 

Once we have the final constraint submanifold N^^^ for abnormality, we have to 
delete the biextremals in the zero fiber because these biextremals do not satisfy the 
necessary condition (2.b) of Pontryagin's Maximum Principle 12.21 For the sake of 
simplicity and clarity, we denote this actual final constraint submanifold with the 
same name N^^K 

Proposition 3.3. // iv|°' / 0, that is, (A, u) € iv|°' with A / 0, then (7, u) = 
{ttm X Id)(A,n) is an abnormal extremal. 

3.2 Characterization of normality 

Analogous to § 13.11 for po = —1, Pontryagin's Hamiltonian is H^~^^ = Hx — F. 
Then the primary constraint submanifold ()3.3p becomes 



iv[~'] = {(A,n)€r*MxC/|A,— - — = 0, l = l,...,k}, (3.6) 
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d'^X^ dX^ dX\ d^F 



the submanifold (13. 4p is 

iv!-l = {(A, „) . ATf-l I A, (x.^ - :^:^) - 

OUrOUi OUrOUi 

In general, the determination of the controls for normal extremals depends on the 
given cost function, unless it is quadratic or linear or independent on the controls. 
To a better understanding of all this process we address the reader to the examples 
in §ia[5l 

It can be observed that Hamilton's equations for are the same for both Hamil- 
tonian functions, for po = and po = —1, since the cost function does not depend 
on the momenta p's. Hamilton's equations for pi are equal for cost functions not 
depending on x*. For instance, if the cost function is constant, as in the case of 
time-optimal. 

The final constraint submanifolds n'j^ and A^j restrict the set of points where 



the biextremals of the Optimal Control Problem 12.11 are. But, even in the case that 
Hamilton's equations are the same, N^^'^ and could be different. Then the 

integral curves of the same vector field in T*M x U along the same extremal in M 
may be different depending on where the initial conditions for the momenta are taken. 
In other words, there may exist abnormal extremals being normal and viceversa. For 
a deeper study about how the extremals are we need to project the biextremals on 
the base manifold M x U using pi = ttm x Id: T*M x U ^ M x U. 

Summarizing all the above comments, we have the following propositions. 

Proposition 3.4. // there exists (A, n) G A'^j ^\ then (7,n) = {ttm x Id)(A,ti) is a 
normal extremal. 

Proposition 3.5. Let (7, u) be an abnormal extremal. If there exists a covector A 
along 7 such that (A, n) G A^j ^\ then (7,ti) is also a normal extremal. 

Let (7, u) be a normal extremal. If there exists a covector A along 7 such that 
{X,u) G ^f'\ then (7,^) is also an abnormal extremal. 

Proposition 3.6. If there exist (A[°l,nM) G xf^ with A^ / and (AI^^I, n^"^') G 

Nj such that 7rA/(A['^l) = 7rjv/(A[~^]) = 7, then 7 is an abnormal extremal and also 
a normal extremal. 

Remark 3.7. In this last proposition we do not consider the control as a part of the 
extremal, because it may happen that different controls give the same extremals in M 
depending on the control system. So we project onto M the biextremals to compare 
them. Under some assumptions about the control systems, such as control-affinity 
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with independent control vector fields, different controls give different extremals. If 
so happens, we will project the biextremals onto M xU through pi to compare them. 

Remark 3.8. The union of both final constraint submanifods do not cover exactly 
the set of extremals in Definition l2.41 because the condition (2. a) in Theorem l2.2l is not 
included in the final constraint submanifolds. See §[l]to get a better understanding. 



3.3 Characterization of strict abnormality 

The normal and abnormal extremals in Definition 12.41 do not constitute a disjoint 
partition of the set of extremals as propositions 13.51 13.61 shows. While in ^ 13.11 we do 
not care about the cost function, in § 13.21 the cost function takes part in the process. 
To characterize strict abnormal extremals the cost function is fundamental because 
these extremals are abnormal, but not normal. The only way to guarantee that an 
extremal is not normal is to use the cost function. 

As a consequence of the final constraint submanifolds obtained from the algorithm 
for abnormality and normality, the strict abnormality can be studied. The adjective 
strict denotes that the extremal only admits one kind of lifts to the cotangent bundle. 
To find strict abnormal extremals we have to project the final constraint submanifolds 
to M. In the intersection there are the extremals admitting two different kinds of 
lifts: with po = and with pQ = —1. This explanation makes evident the presence of 
the cost function to study strict abnormality because the final constraint submanifold 
for normality is used. 

To sum up, all the biextremals in iVp' and N^j, are projected through p = 
TTM o vTi : T*M X [/ ^ M due to Remark [321 

Proposition 3.9. Let P = p{Nf) n p(A^|"^'). 

(i) If P = % and p{N^j^) ^ 0, then all the abnormal extremals are strict, 

(a) If P = % and p{N^j 7^ 0, then all the normal extremals are strict normal. 

(Hi) If P ^ ^ and p{N^^^) = P, then there are no strict abnormal extremals. 

(iv) If P ^% and p{Ny^) ^ P, then there are locally abnormal extremals. 

(v) If P ^ % and p{N^^^) = = P, then all the abnormal extremals are also 
normal and viceversa. 



In item (iv), it is said that there are strict abnormal extremals, but only locally 
since the extremal could have pieces in P. So at some points the extremal can be 
locally normal. 
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4 Free-time optimal control problem 

Once the theory has been introduced let us deal with the particular case of the free 
time OCP. In this case the interval of definition of the extremals is another unknown 
of the problem. 

Problem 4.1. (Free-time Optimal Control Problem, FOCP) 

Given M , U , X, F , Xa, Xf, M (as in ^ [^. Find (7, u) and / = [a, 6] C M such that 

(1) 7(a) = Xa, 7(6) = Xb, 

(2) 7(t) = X{-f{t),u{t)), t G /, and 

(3) 5[7,u] is minimum over all curves on M x U satisfying (1) and (2). 
Pontryagin's Maximum Principle is the same as Theorem 12.21 but replacing (2. a) 

by 

(2. a') H{X{t),u{t)) is zero every where t G /. 

Thus the presymplectic equation (12. 2p must be restricted to the submanifold defined 
by the condition 

H = Hx +PoF = 0- 

Hence, it must also be stabilized in the algorithm. Due to the properties of hamilto- 
nian systems [T], the condition H = is trivially stabilized along integral curves of 
the hamiltonian vector field. Thus its tangency condition does not add any new con- 
straint to the submanifolds of the algorithm. The same happens with H = constant, 
but this is not a suitable constraint for a submanifold, that is why it was not in- 
cluded in the primary constraint submanifold for fixed-time OCP § El In contrast 
to Remark 13. 8^ the final constraint submanifolds we find here recover exactly the 
whole set of extremals since all the necessary conditions of Theorem 12.21 are taking 
into account. The trivial stabilization oi H = makes possible to run the algorithm 
putting aside, then the same final constraint submanifolds as in § 13. H 13.21 are ob- 
tained. Those submanifolds are renamed, respectively, as N^^j and -^jj^' since the 
actual final constraint submanifolds are obtained by considering the vanishing of the 
Hamiltonian: 

AtM = Nf} n {(A, u) G T*M xU\Hx = 0}, 
Af|~^' = Ny/^ n{{\,u) eT*M xU\Hx - F = 0}. 

Due to condition {2.b) in Theorem 12.21 the zero fiber must be deleted from N^. 
Proposition 4.2. Given a free-time optimal control problem: 

1. If has only zero covectors, there are no abnormal extremals. 

2. If has nonzero covectors and ivj'J! C {(A,^) G T*M x U \ Hx = 0}, then 
every abnormal extremal is strict and there are no normal extremals as long as 
F does not vanish. 
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5 Example 

There are some classical optimal control problems where the classification of ex- 
tremals has been described with different tools and approaches: geodesies in Rie- 
mannian geometry [23], shortest-paths in subRiemannian geometry [21 [23] and OCPs 
with control-affine systems [31 HI [351 [33] . All of them can be studied in a unified way 
by direct application of the method we have proposed in this paper. Here we are 
going to use the algorithm for a particular example. 



5.1 Control-afRne mechanical system 



Following the described method we find a strict abnormal extremal for a control-affine 
system on TQ, that, in fact, models an affine connection control mechanical system. 
See more details about these systems in [9]. 

Let M = TQ = TR^ (i.e. Q = M^), U be an open set in containing the zero. 
In local natural coordinates {x,y, z,Vx,Vy,Vz) for TQ, the drift vector field of the 
control-system is 

d_ d_ d_ 

' dx ^ dy ^ dz ^ 
d 

and the input vector fields are Yi = 7^ — and Y2 = {1 



Z 



d 



+ X 



d 



So the 



control system is given by Z -|- u-[Yi + U2Y2. The endpoint conditions on TQ are 
Va = (2, 0, 0, 0, v°y,4{l - v^)), Vb = (2, 1, 0, 0, 2(1 - t;^), 4^;0 - 4) with v^y / 1. The cost 

function is F = ^ ^ ^ . Hence Pontryagin's Hamiltonian is 



H{X,Ui,U2) = PxVx+PyVy+PzVz + UiQx + tt2(l - x)qy + U2X^q, 

with Hamilton's equations for abnormality and normality 

V'x = Ul Px 

Vy=U2{l-X) Py 



■Po 



X 

y 

z ■ 



Vx 

Vy 

Vz 



qyU2 - 2qzU2X (jx = -Px 

qy = -Py 

qz = -Pz 



Vz = U2X- Pz 

and Hamiltonian vector field Xh = Z]iG{x y zji^^ d / di+B^ d / dvi+Cid / dpi+Did / dqi) + 
Eid/dui + E2d/du2, where A^,B^,Ci, Di are determined by Hamilton's equations. 

The constraint algorithm for abnormality gives us 

dH^^^/dukiX,u) = HY^iX) = 0, A; = 1,2} 
Qx = 0, qy(l q^x^ = 0} 

H[z,Y,M) = for A; = 1,2} 
Px = 0, {-1+ x)py - x^pz - Vxqy + 2xvxqz = 0} 

iH[z,[z,Yk]]+u,[Y,,[z,Y,]])W = for A: = 1, 2} 
(-qy + 2xqz)u2 = 0, 

{-qy + 2xqz)ui = -{2pyVx - 4:XVxPz + 2vlqz)} . 





= {(A,n) 


G T*TQ X 


u 




= {(A,n) 


e T*TQ X 


u 




= {(A,n) 








= {(A,n) 








= {(A,n) 








= {(A,n) 
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In order to satisfy the endpoint conditions, not to have the zero covector and to have 
a strict abnormal extremal, the subset defined by x (^x — 1) U2 = 0, coming from 
the above bold equations, must be deleted from the constraint submanifold. Then 

A^i°l = {{\,u)eT*TQxU-{x{x-l)q,U2 = 0}\qx = 0, -qy + 4qz = 0, Px = 0, 
Py - = 0, x = 2, Vx = 0} 

ivf 1 = {(A, u) £ ivj°^ \vx = 0, ui = 0} 

By restriction to the final constraint submanifold and integrating Hamilton's equa- 
tions on [0, 1] we have A(t) = (0, 4p°,p°, 0, -4p°t + 4g°, + and 

7(t) = (2, -U2- + v^t, 2u2t^ + 4(1 - v^)t, 0, -U2t + v^, Au2t + 4(1 - v^)) 

with U2 = 2(7;° - 1). 

The constraint algorithm for normality gives us 

iV(S"^l = {{\u)eT*TQxU 
= {{X,u) eT*TQ xU 

If we substitute the curve 7 in Hamilton's equations, we have ui = and U2 = 
2(1 — Vy), then for the primary constraint submanifold Qx = and U2 = % — ^Qz ■ Due 
to Hamilton's equations Px = and Q = px = u^. This last equality is only possible 
if uJJ = 1, but that was not the hypothesis. Thus there does not exist a covector with 
Pq = —1 along 7, that is, 7 is a strict abnormal extremal whenever Vy ^ 1. 



/duk{X, u) = , A; = 1, 2} 
qy{l -x)+ q,x^ -U2 = 0} = n['^^ = N. 



6 Conclusion and outlook 

In this paper we have given a geometric method to study different kinds of extremals 
in a wide range of optimal control problems with an open control set. This can 
also be applied in the case of closed control set following ideas in [21]. This method 
is based on the suitable reinterpretation of the so-called presymplectic algorithm in 
other fields. The dependence on the cost function makes difficult to give general 
characterizations of normal and strict abnormal extremals since each problem must 
be studied by itself. However, the abnormal extremals only depend on the geometry 
of the control system, so some general results can be deduced. See [7] for an approach 
to a related problem for single-input control-affine systems. 

One line of future research is to apply this general algorithm in the study of 
optimal control problems with affine connection control systems, which model the 
motion of different types of mechanical systems such as rigid bodies, nonholonomic 
systems and robotic arms [9]. Eventually, we will focus on particular problems for 
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mechanical systems, as for instance time-optimal problems and control-quadratic cost 
function. 

Apart from having sufficient conditions to determine where the extremals are, 
it may be interesting to prove the density and the optimality of them, similar to 
the work done in [53] for control-linear systems with two input vector fields. Here 
the cost function takes part in, even in determining the optimality of abnormal ex- 
tremals. There are some results that do not contribute to the optimism in relation 
to the existence of strict abnormal minimizers, at least in a generic sense. For in- 
stance, in [m [12] it is proved the existence of an open and dense subset in the set of 
control systems where every nontrivial strict abnormal extremal is not a minimizer 
for control-quadratic cost functions and control-affine systems. 

Another meaningful research issue is to establish connections between the con- 
trollability of the system [Oj [28| [3T] and the final constraint submanifold obtained for 
abnormality, since both notions are independent of the functional to be minimized. 
In fact, we are already working on some properties of controllability, similar to results 
in [5], that can also be justified using the algorithm here described. 
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